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I.  INTRODUCTION 

Host  problems  of  electromagnetic  theory  can  be  formulated  in  terms 
of  an  operator  equation 

Ax  =  y,  (I) 

where  in  general  A  is  an  integro-differential  operator  and  x  is  the 
unknown  to  be  obtained  for  the  particular  excitation  y. 

The  approximate  methods  of  solving  integro-differential  equations 
of  electromagnet i cs  are  varied  in  respect  to  the  ideas  lying  at  their 
foundation.  A  number  of  methods  (Variational  method,  Rayleigh-Ri tz 
method,  Galerkin's  method,  method  of  moments,  method  of  least  squares, 
and  so  on)  has  been  elaborated.  At  the  same  time  the  analysis  of 
these  methods,  particularly  in  electromagnetic  theory,  has  not  advanced 
far.  Host  methods  have  remained  without  any  theoretical  analysis 
and  have  only  been  verified  by  their  effectiveness  in  individual 
examples . 

As  is  generally  known,  the  majority  of  the  linear  problems  of 
analysis  may  be  reduced  to  the  problem  of  the  extremem  of  quadratic 
functionals.  This  fact  may  be  utilized  on  the  one  hand  for  different 
theoretical  investigations  relating  to  these  problems  (theorems  of  the 
existence  of  a  solution,  properties  of  the  eigenvalues  and  so  on).  On 
the  other  hand  it  serves  as  a  basis  for  direct  methods  for  solving 
the  problems  named. 

In  this  paper  a  certain  method  of  successive  approximations  -  the 
method  of  steepest  descent  -  for  the  solution  of  problems  concerning  the 
minimum  for  quadratic  functionals  and  of  the  linear  problems  connected 
with  them  is  elaborated. 
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The  idea  of  this  method  goes  back  to  Cauchy,  who  proposed  it 
in  1895  for  the  solution  of  the  problems  of  the  minimum  of  a  function 
of  N  variables,  and  a  problem  similar  to  that:  the  solution  of  a  system 
of  N  algebraic  equations  in  N  unknowns.  Other  attempts  at  developing 
the  ideas  of  Cauchy  have  been  made  in  the  works  of  Temple  f 1 J , 

Courant  [2]  and  Kantorovich  [3]  who  provided  the  mathematical  foundation 
of  the  method  of  steepest  descent. 

The  principle  distinction  between  the  method  of  steepest  descent 
and  the  method  of  Rayleigh-Ri tz,  Galerkin 's,and  the  method  of  least 
squares  is  that  the  sequence  of  approximations  is  not  obtained  in  a 
form  selected  a  priori,  but  in  a  form  determined  by  the  problem  itself. 
From  the  Neumann  series  or  the  Picard's  method  of  successive  approxi¬ 
mations  [4 ]  this  method  is  distinguished  by  the  size  of  the  region  of 
convergence  -  which  in  a  number  of  important  cases  coincides  with  the 
region  of  existence  of  the  solution  -  as  well  as  by  the  nonlinear 
character  of  the  dependence  of  successive  approximations. 

During  the  theoretical  investigation  of  every  approximate  method, 
the  following  three  problems  generally  arise,  in  the  order  of  increasing 
accuracy  and  difficulty: 

(a)  The  establishment  of  convergence. 

(b)  The  investigation  of  the  rapidity  of  convergence. 

(c)  An  effective  estimate  of  error. 

The  solution  of  these  problems  is  quite  complex  and  demands  a  special 
individual  approach  in  each  instance. 

In  this  paper  we  present  the  mathematical  foundation  of  the  method 
of  steepest  descent  and  apply  it  to  the  solution  of  electrostatic 
field  problems.  It  is  noted  that  this  method  requires  considerably 
less  computer  storage  than  the  method  of  moment  formulation  using 
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subdomain  expansion  and  testing  [11].  Since  the  method  is  iterative  a 
good  guess  may  considerably  reduce  the  computation  time. 

Since  electrostatic  problems  represent  the  static  limit  (frequency 
approaches  zero'  of  the  corresponding  electromagnetic  problems,  the 
problems  treated  in  this  paper  therefore  represent  the  first  step  towards 
the  development  of  this  iterative  technique  for  the  electrodynamic  case. 

2.  THE  MET  HOD  OF  STEEPEST  DESCENT 

We  start  the  description  of  this  method  by  defining  a  quadratic 
functional  I(x)  in  a  linear  normed  space.  The  functional  I(x)  is 
defined  by 

I(x)  =  <r,Sr>,  (2) 

where  the  inner  product  is  defined  as 

<C,D>  =  /C(x)D(x)dx.  (3) 

x 

In  (3)  F(x)  denotes  the  complex  conjugate  of  D(x)  and  the  norm  of 
C  is  given  by 

1 1  c  I  I2  =  <C,C>  =  / ic2  (x) | dx .  (M 

In  (2)  S  is  a  hermitian  positive  definite  operator  and 

r  *  Ax-y  (5) 

By  a  quadratic  we  mean  a  functional  I(x)  such  that  the  expression 
I(x+ap)  is  a  polynomial  of  second  degree  in  a,  whatever  elements  x  and 
p  may  be.  In  seeking  the  minimun  of  the  quadratic  functional  I(x+ap) 
we  use  an  arbitrary  element  Xg  as  an  initial  approximation  and  the 
direction  of  the  gradient  at  the  point  Xg  is  given  by 

^  [I(xg-Kxp)]  *  gjj  [<r,Sr>+<aSAp,r>+<Sr ,aAp>+<aSAp,aAp>] .  (6) 

We  select  a  normed  element  P*Pg»  so  that  the  derivative  In  (6)  for 
a*0  will  be  a  maximum.  Since  I(xg+ap)  is  a  polynomial  of  second  degree 
in  a,  for  a  certain  a*cig,  it  will  attain  a  minimum  value.  The  element 
X|MXg-oigPg  we  adopt  as  the  next  approximation,  In  turn,  after  which  the 


Iteration  becomes 


x  ,  =  x  -a  p  .  17 ) 

n+1  n  x  n 

So  from  the  starting  point  x  ,  the  approximation  proceeds  in  the 

n 

direction  p  for  a  distance  a  along  the  surface  I(x  ),  attempting  to 
n  n  n 

choose  an  and  p^  at  each  step  so  as  to  approach  the  minimum  point  of 
I(x).  The  best  choice  of  p  would  of  course  be  in  the  direction  of  the 
error  vector  xg-x,  but  this  vector  is  unfortunately  not  k-iown.  Here  x e 
is  the  exact  solution.  In  the  next  section  it  is  shown  how  to  select 
Pn  for  the  various  functionals  I (x)  that  are  associated  with  the  method 
of  steepest  descent. 

Next  we  compute  the  optimum  step  length  a  in  the  direction  of  p  such 
that  the  quadratic  functional  J(x+ap)  is  minimi2ed.  This  implies  that  in  (6) 

[I(x+ap)]  -  0  (8) 

resulting  in 

a  =  <r>SAp>  (9) 

“  <Ap,$Ap>  ' 

In  the  next  section,  for  various  search  directions  p,  the  optimum  values 
of  a  are  given. 

The  process  under  discussion  may  be  interpreted  geometrically.  First 
let  the  space  in  which  the  functional  E(x)  is  defined  be  two  dimensional. 

The  contour  lines  I (x )  are,  in  general,  a  family  of  similar  ellipses 
with  center  at  the  minimum  point.  The  point  x^,  with  which  we  began  the 
process,  lies  in  a  certain  ellipse  of  the  family,  viz.  on  I(x)*I(x0).  From 
it  we  go  in  the  direction  of  the  gradient,  i.e.  along  the  normal  to  this 
ellipse,  to  a  point  corresponding  to  the  least  value  I(x)  on  this  normal, 
i.e.  to  the  point  Xj ,  where  it  touches  (is  tangent  to)  some  ellipse  of  the 
family.  From  this  point  we  go  along  the  normal  to  the  ellipse  I(x)»I(Xj) 
and  so  forth.  If  the  number  of  dimensions  of  the  space  be  more  than  two,  in  pi. 
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a  family  of  ellipses  there  is  a  family  of  ellipsoids,  and  instead 
of  the  contour  there  are  surfaces.  However,  each  step  of  the  process 
may  be  examined  in  a  plane,  viz.,  the  plane  that  passes  through  the 
minimum  point  and  the  points  x^  and  x^.  The  sections  of  the  ellipsoids 
by  the  plane  will  be  families  of  ellipses  resembling  the  two  dimensional 
case. 

3.  DEVELOPMENT  OF  THE  METHOD  OF  STEEPEST  DESCENT 

Several  different  functionals  are  available  as  error  measures  to  be 

used  in  conjunction  with  the  method  of  steepest  descent.  The  three 

most  popular  functionals  are  described  along  with  the  corresponding 

versions  of  the  method  of  steepest  descent.  We  also  note  the  limitations 

associated  with  each  of  the  functionals.  In  the  development  of  this 

section  we  assume  Ax=0  in  (l)  has  only  the  zero  solution.  This 

restriction  is  relaxed  in  the  next  section,  however. 

(a)  Minimization  in  the  domain  of  A 

In  this  case,  the  functional  is  chosen  as 

1  (a)  *  <x-x  ,  x-x  > 
a  e  e 

*  <A  ^Ax-y),  A  1(Ax-y)>  =  <A  V.A  V> 

=  <rftA'1]*[A_1]r>,  (10) 

where 

x  =  exact  solution 
e 

r  *  Ax-y 

$a  -  tA_1 ]*[A_1 ] 

(A]*  =  adjoint  of  [A]  (11) 

For  this  functional,  at  each  iteration  the  error  between  the  approximate 

solution  x  at  the  end  of  n  iterations  and  the  exact  solution  x  Is 
n  e 

made  smaller  than  the  error  between  xn_^~xe*  The  convergence  is 
monotonic  as  proved  in  the  next  section.  However,  the  residuals  may 
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oscillate.  This  implies  that  there  is  no  guarantee  whatsoever  that 
I |Axn-yl |  =  ||rn||  >  I  I rn+1 1 1  -  liAxn+1-y||  for  all  n.  (12) 
The  method  of  steepest  descent  for  the  functional  I  (x)  is 

d 

described  below.  The  directions  p  are  chosen  as 

n 

Pn  =  •  (13) 

So  from  (7)  and  (13),  ctn  is  given  by 


<r  ,S  Ap  > 
n  a  rn 

an  <Ap  , S  Ap  > 
Kn*  a  rn 

<r  ,r  > 
n  n 


<A*r  ,A*r  > 
n  n 


ll> 


A*r 


[uti 1 izing(l l)  ] 


(14) 


and  the  iteration  is  given  by 

i  i  it  2 


x  . ,  *  x  - 
n+l  n 


A*r 


TA*r„ 


X 

n 


|Axn-y| 


| A* [Ax  -y] 


A*[Ax  -y] . 


(15) 


It  is  important  that  if  y  t  R(A)  the  iteration  defined  by  (15)  does  not 
converge  at  all.  Here  R(A)  is  defined  as  the  range  space  of  A. 

(b)  Minimization  in  the  range  of  A 
For  this  case 

lb(x)  *  <r ,r>  =  <Ax-y ,  Ax-y>  ( 1 6) 


which  implies 

=  Identity  operator.  (17) 

However,  there  are  two  versions  of  this  particular  method  of  steepest 
descent  depending  on  the  choice  of  pn.  The  choice  of  pn  for  this  case 
depends  also  on  the  operator  A. 
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(i)  If  A  is  positive/negative  definite,  then  we  choose 

pn  =  V  (18) 

From  (7)  and  (18)  a  is  given  by 
n 


a  = 


<r  ,Ar  > 
n  n 


09) 


n  <Ar  ,Ar  > 
n  n 


and  the  iteration  for  this  special  operator  is  defined  by 


<r  ,Ar  > 

_  _  n  n 

xn+l  Xn  <Ar  ,Ar  >  rn 
n  n 


<Ax  -y,A[Ax  -y]> 


_  _  n  _ _ n_ 

Xfl  |  |A(Ax  -y)  |  |2 


[Axn-y] 


(20) 


(ii)  If  A  is  an  arbitrary  operator,  we  choose 

p  =  A*r  (same  as  in  (13)]  • 
n  n 

For  this  particular  choice  of  Pn>  and  utilizing  (17)  we  get 


<r  ,AA*r  > 
n  n 

n  <AA*r  ,AA*r  > 
n’  n 


|A*r 


a  = 


i|AA*r 


(21) 


The  method  of  steepest  descent  is  then  described  by  the  iteration 

,2 


x  ,  =  x 
n+1  n 


=  x  - 
n 


|A*rjr 


■=■  A*r 
2  n 


I AA*rn  I  I 

|A*[Axn-y]  | 
| AA* [Ax  -y] 


T  AMAxn-y). 


(22) 


It  is  important  to  p°'nt  out  that  for  both  (i)  and  (ii)  the 
residuals  decrease  monotonical ly  at  each  iteration.  However,  there 
is  no  guarantee  for  an  arbitrary  operator  A  that  the  corresponding 


errors  in  the  solutions  x  would  be  small.  In  other  words  the 

n 

following  inequality  is  not  satisfied: 


| |x  -x  | 
'  '  n  e  1 


'vrv 


for  all  n. 


(23) 
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The  method  of  steepest  descent  described  by  (20)  or  (22)  converges 
to  the  exact  solution  if  y  e  R(A).  If  y  t  R ( A )  then  the  iterations 
described  by  (20)  or  (22)  converge  to  a  least  squares  solution  with 
the  minimum  norm.  It  is  interesting  to  point  out  that  the  same 
functional  as  described  in  (16)  is  also  minimized  in  the  application 
of  the  method  of  least  squares. 

(c)  Minimization  both  in  domain  and  range  of  A. 

In  the  method  of  steepest  descent  tnis  choice  of  the  functional 
works  only  if  A  is  positive/negative  definite.  The  functional  is 
defined  as 


I  (x)  =  <x-x  ,A(x-x  )> 
c  e  e 

=  <A-1r,r>  =  <r,[A~I]*r> 

and  therefore 

sc  =  [A'1]*. 

In  this  case  we  select  the  paths  pn  as 

p  =  r  [same  as  in  (18)] . 
n  n 

Utilizing  (7)  and  (18)  we  obtain 

<r  ,r  >  | | r  j | 2 

_  n  n  _  11  n 1 

“n  "  <r  ,Ar  >  =  <r  ,Ar  >  ' 
n  n  n  n 


(2A) 

(25) 

(26) 


The  iterations  defined  by  (27)  converge  to  the  exact  solution  if 
and  only  if 


(1)  A  is  positive/negative  definite,  and 

(2)  y  t  R(A) 


(28) 


If  either  of  these  two  conditions  is  violated,  the  convergence  of  (27) 
is  not  assured. 
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It  is  interesting  to  note  that  the  same  functional  lc(x)  defined  by 
(2k)  is  minimized  in  the  application  of  the  variational  -  Rayleigh-Ri tz 
and  Galerkin's  methods.  From  the  above  discussion  it  thus  becomes  clear 
that  in  Rayleigh-Ri tz  and  Galerkin's  methods  there  is  no  guarantee  of 
the  convergence  of  the  solutions  as  n+°°  if  either  of  the  conditions 
in  (28)  is  violated.  An  example  has  been  presented  in  the  Appendix,  to 
illustrate  the  above  phenomenon,  when  none  of  the  conditions  in  (28) 
are  satisfied. 

k.  RATE  OF  CONVERGENCE  OF  THE  METHOD  OF  STEEPEST  DESCENT 


The  method  of  steepest  descent  utilizes  the  iterative  process 


n+1  n  n'  n 

In  order  to  stop  the  iterative  process,  we  make  sure  that  the 
residuals  are  below  a  certain  small  value,  i.e. 


I Axn~v ! I  <  e* 


(29) 


In  practice,  we  have  found  specifying  this  criterion  is  equivalent  to 
restricting 


a  -a  . , 

1  n  n+1 


<  e. 


(30) 


i.e,  the  values  of  a  have  settled  to  a  stable  numerical  value, 
n 

Observe  that  for  the  iterative  processes  described  by  (20) ,  (22),  and 
(27)  the  value  of  ctn  has  settled  to  the  smallest  eigenvalue  of  the 
operator  A  in  the  finite  dimensional  space  in  which  the  problem  is 
being  solved.  For  the  iterative  process  in  (15)  It  a  yields  the 

n+«>  n 

smallest  eigenvalue  of  the  adjoint  operator  A*  in  the  finite  dimensional 
space  in  which  the  problem  is  represented. 

The  next  question  that  automatically  rises  is  how  fast  do  these  an 
converge,  or  xn's  approach  the  true  solution  xg,  or  the  residuals  r^ 
converge  to  zero.  These  questions  are  answered  by  the  following  theorems. 
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Theorem  1 :  The  sequence  {xn ln=0, 1 ,2, . . . }  generated  by  (15)  for 
the  functional  lg(x),  derived  by  the  method  of  steepest  descent  satisfies 


The  proof  of  this  theorem  can  be  found  in  [5-7] .  The  proof  assumes  that 
y  e  R(A),  otherwise  (15)  does  not  converge. 


Theorem  2:  The  sequence  generated  by  (22)  for  the  functional 

lb(x),  derived  by  the  method  of  steepest  descent  satisfies 


|x  -x  ||  <  |  | A 
1  n  e 1  1  —  1  1 


■III  J  { I IM  I  *  I  I  A~ 1 1  1 1^-1 
\(||A||.||A-'||)2*! 


| |A*Axo-A*y| | •  (32) 


The  proof  of  this  theorem  is  given  in  [5~7] . 

The  estimate  (32)  is  valid  even  if  y  t  R(A).  In  that  case  A  ' 


should  be  interpreted  as  the  generalized  inverse  of  A. 

Theorem  3:  The  sequence  (xn)  generated  by  (27)  for  the  functional 
lc(x),  derived  by  the  method  of  steepest  descent  satisfies 


The  proof  of  this  theorem  can  be  obtained  from  [8]. 

Observe  that  out  of  the  three  estimates  (31),  (32)  and  (33),  the 


last  one  has  the  best  rate  of  convergence.  However,  it  is  only 
applicable  to  a  certain  restricted  class  of  definite  operators  A. 

(31)  yields  a  better  rate  of  convergence  than  (32).  However,  the 
assumption  is  y  e  R(A)  -  which  may  be  valid  for  a  wide  class  of  problems 
of  interest.  However,  if  y  t  R(A),  (31)  no  longer  holds  and  the  only 
iterative  technique  that  is  available  is  (22).  The  rate  of  convergence 
of  (xn)  for  the  iterative  method  in  (22)  is  given  by  (32). 


n 


Now  if  | | A  '||  is  unbounded  or  if  A  '  does  not  exist  (when  Ax«0 
has  a  nontrivial  solution)  then  the  above  three  theorems  cease  to  be 
true  entirely,  just  because  the  solution  cannot  exist  or  is  not  unique. 
Under  these  circumstances,  a  weaker  assertion  holds  and  is  given  by 
theorem  4. 

Theorem  4:  If  Ax=0  has  a  nontrivial  solution,  or  if  j | A  '|| 
is  unbounded,  then  each  successive  approximation  is  nearer  to  xg  than 
is  the  preceeding,  i.e. 


i  i  1 2  A  o 

i  1L-LL- — u— 


x  -x  |  1 2 
e 


I |A| |2*C+n| |xQ-xe| |2 
where  C  are  certain  constants  which  depend  on  xq  and  y,  and 


(34) 


2 

r  -r  . .  >  Q  r  ,  where  Q  is  a  constant.  (35) 

n  n+ 1  —  n 

The  proof  of  (34)  is  given  in  [9]  and  that  of  (35)  in  [3].  From  (35) 

it  is  seen  that  the  numbers  r^  diminish,  have  a  finite  limit  and  by 

passing  to  the  limit  in  (27)  one  is  easily  convinced  that  the  limit 

is  equal  to  zero.  On  this  basis  of  inequality  (35)  it  is  seen  that  [3] 

r  =  Q(l/n)  =  [of  the  order  of  1/n] 
n 

and  hence  the  rate  of  convergence  is  of  the  order  of  1/n,  which  is 
explicitly  given  by  (34). 

5.  NUMERICAL  RESULTS 


In  this  section,  the  method  of  steepest  descent,  described  so  far, 
is  applied  to  the  solution  of  electrostatic  problems.  In  this  case  the 
operator  A  is  real  and  self  adjoint.  Hence  we  have  used  the  iterative  - 
method  given  by  (27).  The  geometries  considered  here  are  a  thin  straight 
wire  and  a  90°  bent  wire  raised  to  a  specified  potential.  The  numerical 
results  are  compared  with  the  method  of  moment  solution  [10]  and  excellent 
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agreement  is  obtained  in  each  case.  A  considerable  reduction  in  the 
computer  storage  is  also  noted  with  the  present  method  which  makes  it 
especially  attractive  for  large  electromagnetic  field  problems.  Since 
the  method  is  iterative,  a  good  initial  guess  may  significantly  reduce 
the  computation  time. 

Straight  Wire 

In  Table  1  we  present  the  charge  induced  on  a  thin  straight  wire 
of  length  1.0m  and  radius  0.001m  raised  to  a  constant  potential 

volts,  where  £q  is  the  free  space  permittivity.  The  wire  is 
divided  into  nine  equal  subsections  and  charge  is  computed  at  the 
center  of  the  subsection.  As  is  evident  from  the  table,  both  solutions 
show  excellent  agreement  up  to  at  least  four  decimal  places. 

The  present  solution  with  the  method  of  steepest  descent  is 
obtained  by  assuming  a  constant  charge  distribution  as  initial  guess 
and  the  method  converged  in  16  iterations.  The  smallest  eigenvalue  of 
the  integral  operator  was  obtained  as  .10285  as  a  by-product. 

We  have  also  solved  the  problem  of  charge  distribution  on  a  3OQ0m 
long  wire  with  QPlm  radius  charged  to  l/Vireo  volts.  The  method 
converged  in  29  iterations. 

Bent  Wire 

In  Table  2,  we  present  the  charge  induced  on  a  90°  bent  wire  raised 
to  a  potential  l/1nreo  volts.  Each  section  of  the  wire  is  1.0m  long 
and  the  radius  is  0.001m.  The  wire  is  divided  into  20  unequal  intervals 
with  more  subsections  in  the  vicinity  of  the  bend.  For  comparison, 
we  present  the  solution  obtained  by  the  method  of  moments  using  pulse 
expansion  and  point  matching.  In  Table  2,  the  parameter  8.  is  measured 
along  the  length  of  the  wire  with  the  bend  at  8-0.  Again  both  the 


TABLE  1 


Charge  induced  (coulombs/m) 


l  (meters) 

Method  of  Moments 

Method  of  Steepest 

Descent 

-0.444 

0.94083  E-01 

0.94084  E-01 

-0.333 

0.83065  E-01 

0.83065  E-01 

-0.222 

0.80153  E-01 

0.80154  E-01 

-0.111 

0.78897  E-01 

0.78897  E-01 

0.0 

0.78532  E-01 

0.78532  E-01 

0.1)1 

0.78897  E-01 

0.78897  E-01 

0.222 

0.80153  E-01 

0.80154  E-01 

0.333 

0.83065  E-01 

0.83065  E-01 

0.44 4 

0.94084  E-01 

0.94084  E-01 

TABLE  2 

Charge  Induced 

(Coulombs/m) 

2  (meters) 

Method  of  Moments 

Method  of  Steepest  Descent 

-0.930 

0.89847267  E-01 

0.89848161  E-01 

-0.790 

0.78931868  E-0? 

0.78932703  E-0 I 

-0.650 

0.75660667  E-01 

0.75661421  E-01 

-0.5)0 

0.73936105  E-01 

0.73936880  E-01 

-0.370 

0.73649168  E-01 

0.73649943  E-01 

-0.270 

0.61391938  E-01 

0.61392322  E-01 

-0.210 

0.62429000  E-01 

0.62429097  E-01 

-0.150 

0.62455501  E-01 

0.62456008  E-01 

-0.090 

0.62318593  E-01 

0.62318966  E-01 

-0.030 

0.62107)46  E-01 

0.62107623  E-01 

0.030 

0.62107511  E-01 

0.62107649  E-01 

0.090 

0.62318355  E-01 

0.62318619  E-01 

0.150 

0.62455675  E-01 

0.62455688  E-01 

0.2)0 

0.62428676  E-01 

0.62428772  E-01 

0.270 

0.61391711  E-01 

0.61391935  E-01 

0.370 

0.73648870  E-01 

0.73649585  E-01 

0.570 

0.73940277  E-01 

0.73940575  E-01 

0.6S0 

0.75661004  E-01 

0.75661361  E-01 

0.790 

0.78932526  E-01 

0.78932822  E-01 

0.930 

0.89945679  E-01 

0.89846134  E-01 
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solution  procedures  show  remarkable  agreement.  Further  note  the 
absence  of  any  anomalies  in  the  solution  of  the  method  of  steepest 
descent  which  indicates  the  capability  of  the  solution  procedure  to 
handle  abrupt  bends. 

Again  as  a  by-product  we  have  obtained  the  smallest  eigenvalue  of 
the  operator,  which  is  .099435.  The  smallest  eigenvalue  of  the  operator 
is  important  as  it  may  tell  us  how  ill-conditioned  the  actual  problem 
is.  If  the  smallest  eigenvalue  turns  out  to  be  extremely  small  then 
we  know  that  the  homogeneous  equation  might  have  a  nontrivial  solution 
and  the  corresponding  method-of-moments  formulation  may  yield  inaccurate 
results. 

Presently  work  Is  being  carried  out  on  the  extension  of  the  method 
of  steepest  descent  to  electromagnetic  problems. 

6.  CONCLUSION 

The  method  6f  steepest  descent  has  been  applied  to  solve 
electrostatic  problems.  Explicit  error  formulas  and  the  rate  of 
convergence  of  the  method  of  steepest  descent  Is  given.  It  Is  shown 
that  this  method  Is  also  suitable  for  analyzing  singular  operator 
equations  which  may  arise  In  certain  electromagnetic  problems.  In 
this  case  the  rate  of  convergence  Is  (1/n).  The  method  yields  as  a 
by-product  the  smallest  eigenvalue  of  the  operator  in  the  finite 
dimensional  space  in  which  the  problem  Is  solved.  Numerical  results 
for  electrostatic  problems  show  excellent  agreement  between  the  method 
of  moments  formulation  and  the  method  of  steepest  descent.  It  is  also 
seen  that  this  method  requires  considerably  less  storage  than  the 
corresponding  method  of  moments  formulation  with  pulse  functions 
as  expansion  and  impulse  functions  as  weighting.  Since  the  method  of 
steepest  descent  is  an  iterative  method,  a  good  initial  guess  may 
considerably  reduce  the  computation  time. 
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8.  APPENDIX 

In  this  appendix  we  illustrate  some  of  the  problems  associated 
with  the  application  of  a  variational-Rayleigh-Ritz  and  Ga!erktn"s 
methods  without  proper  examination  of  the  operator  itself. 


As  an  example  consider  the  solution  of  the  equation  *  1  in  the  region 

0<z<1  with  x(z=0)=0  The  exact  solution  to  this  problem  is  x  *z.  Assume 
-  r  exact 

that  an  approximate  solution  for  z  is  sought  as 


x=  l  asin  f  (36) 

n=l ,3,5,7,.. 

The  functions  sin  are  orthogonal  in  the  range  0£z£l  and  form  a  complete 
set.  We  can  obtain  an  approximate  solution  of  the  above  equation  using 
the  concepts  of  Fourier  series.  In  this  case  we  minimize  the  functional 

I(2)  =  j  [^7  {n  i  Vin  ^  -  1]2dz  (37) 

0  odd 

The  solution  is  obtained  as 

v  8  .  nn  .  nuz 

*F  =  n  l  TT  S,n  T  S,n  —  (38) 

odd  n  tt 

We  could  have  also  solved  the  above  differential  equation  by  blind  application 
of  Galerkin's  method.  In  that  case,  we  solve  the  following  equations  (10) 


d  r  .  nirz  ,  .  m7Tz„  -  , 

—  )  a  sin  — - 1;  sin  — =— >  =  0  for 

rl7  n  L  n  9  7  9 


The  various  orders  of  approximation  obtained  by  Galerkin's  method  are 
presented  in  Figures  1  and  2.  Observe  that  the  convergence  obtained  using 
Galerkin's  method  in  this  case  is  highly  irregular.  Observe  neither 


2,  >2 


Lt  llxjr  A  (/xZdz) 


exact 


nor  Lt  Ax 


monotonical ly.  Yet  an  approximate  solution  may  be  obtained  as  the  dimension 
of  the  problem  is  increased.  Note  that  the  error  in  a  one  term  Fourier 
series  solution  is  as  large  as  that  of  a  one  hundred  term  Galerkin's  method 
solution. 

It  is  important  to  point  out  that  a  Galerkin's  method  is  not 
applicable  for  this  problem  since  the  same  expansion  functions  do  not  form 
a  complete  set,  both  in  the  domain  (D(A)}  and  in  the  range  { R ( A) }  of  the 
operator  A.  Yet  a  numerically  meaningful  result  may  sometimes  be  obtained 
if  the  order  of  the  approximation  is  chosen  as  a  large  number.  In  summary, 
if  one  formally  applies  Galerkin's  method  to  a  problem  for  which  it  is  not 
applicable,  one  may  obtain  an  approximate  solution  if  a  large  number  of 
expansion  function  is  chosen.  However  convergence  of  the  solutions  in 
some  cases  may  be  erratic  as  shown  in  the  figures. 


NUMBER  OF  EXPANSION  FUNCTIONS 

Figure  1.  Plot  of  jjxjt2  against  the  number  of  expansion  functions 


Plot  of  ||AxQ|p  for  Galerkin’s  method  and  the  Fourier  series 
solution  against  the  number  of  expansion  functions. 


